1 



Irreversible Circulation of Fluctuation and Entropy Production 

Hiroyuki Tomita 1 and Mitsusada M. Sano 2 

1 Interdisciplinary Graduate School of Science and Engineering, 

Kinki University, 
Higashi-Osaka 577-8502, Japan 

2 Graduate School of Human and Environmental Studies, 
Kyoto University, 
Kyoto 606-8501, Japan 

Physical and chemical stochastic processes described by the master equation are investi- 
gated. The system-size expansion, called the J?-expansion, transforms the master equation 
to the corresponding Fokker-Planck equation. In this paper, we examine the entropy pro- 
duction for both the master equation and the corresponding Fokker-Planck equation. For 
the master equation, the exact expression of the entropy production was recently derived 
by Gaspard using Kolmogorov-Sinai entropy (J.Stat.Phys. 117 (2004), 599 [Errata; 126 
(2006), 1109]). Although Gaspard's expression is derived from a stochastic consideration, 
it should be noted that it coincides with the thermodynamical expression. For the corre- 
sponding Fokker-Planck equation, by using the detailed imbalance relation, which appears 
in the process of deriving the fluctuation theorem through the Onsager-Machlup theory, the 
entropy production is expressed in terms of the irreversible circulation of fluctuation, which 
was proposed by Tomita and Tomita (Prog.Theor.Phys. 51 (1974), 1731 [Errata; 53 (1975), 
1546b]). However, this expression for the corresponding Fokker-Planck equation differs from 
that of the entropy production for the master equation. This discrepancy is due to the dif- 
ference between the master equation and the corresponding Fokker-Planck equation, namely 
the former treats discrete events, but the latter equation is an approximation of the former 
one. In fact, in the latter equation, the original discrete events are smoothed out. To over- 
come this difficulty, we propose a hypothetical path weight principle. By using this principle, 
the modified expression of the entropy production for the corresponding Fokker-Planck equa- 
tion coincides with that of the master equation (i.e., the thermodynamical expression) for a 
simple chemical reaction system and a diffusion system. 

§1. Introduction 

Theories on nonequilibrium systems near equilibrium have been successful. In 
fact, a number of landmarks have been achieved in nonequilibrium statistical physics, 
such as Onsager's reciprocal relation 1 )' 2 ) and the Kubo formula. 3 ^ However, there 
has been no satisfactory theory on nonequilibrium steady states (NESS) until the 
recent discovery of the fluctuation theorem focused on the NESS. 4 ' 9 ) With such 
developments, the study of the NESS (i.e., the characterization of the NESS) is a 
little revival. The fluctuation theorem gives us some indications of how to investigate 
the NESS. However, theorists consider individual problems from their perspective. 
A unified viewpoint is lacking in the present study of the NESS. 

In this paper, as an attempt to improve the present situation, we construct 
a theory of the NESS for certain stochastic processes, i.e., the master equation 
and the Fokker-Planck equation. The entropy production for these equations is 
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examined. For the master equation, in a pioneering work by Schnakenberg, 10 ) an 
exact expression of the entropy production for the master equation was derived. 
Recently Gaspard also derived this equation starting from Kolmogorov-Sinai (KS) 
entropy. 11 ^ His formula is 

(a e ) = -AS t = h R - h, (1-1) 

T 

where h is the KS entropy and h R is the time-reversed KS entropy. Throughout this 
paper, we set the Boltzmann constant ks = 1 and we use the following notation 
for the entropy production, namely, the thermodynamical entropy production cr e ,th 
and the stochastic averaged entropy production (er e ). Equation coincides with 
Schnakenberg's result. It should be noted that it also agrees with the thermodynam- 
ical result. Thus, the entropy production defined by the stochastic process coincides 
with the corresponding thermodynamical entropy production. 

In the 1970s, systematic studies were carried out on the master equation. 12 )> 13 ) 
Kubo et al. 12 ) applied the system-size expansion, called the ^-expansion, which 
was developed by van Kampen, 14 ) to the master equation. They derived the corre- 
sponding Fokker-Planck equation and analyzed the behavior of the fluctuation. Later 
Tomita and Tomita developed Kubo et al. 's work and emphasized the importance of 
the circulation of fluctuation in nonequilibrium states. 13 ) In particular, in the NESS, 
they showed that the probability flow circulates. Successively, Tomita et al. applied 
the Onsager-Machlup theory 15 )' 16 ) to the result of Ref. 13). 17 ) Unfortunately, in 
Refs. 13) and 17), the entropy production was not investigated. 

Recently, Taniguchi and Cohen extended the Onsager-Machlup theory to sev- 
eral Langevin systems 19 ) -21 ) and derived a fluctuation theorem for them. A key 
relation in the fluctuation theorem is the detailed imbalance relation (they called it 
the nonequilibrium detailed balance relation), i.e., the violation of the detailed bal- 
ance relation. In this paper, on the basis of this key relation, we shall evaluate the 
entropy production of the Fokker-Planck equation derived from the master equation. 
However, this entropy production does not coincide with the entropy production for 
the original master equation. The reason for this will be examined in detail. The 
difference between them is due to the fact that our master equation treats discrete 
events, but the Fokker-Planck equation is an approximation of it. In the Fokker- 
Planck equation, the original discrete events are smoothed out. To overcome this 
difficulty, we propose a path weight principle. Using this path weight principle, the 
modified entropy production for the corresponding Fokker-Planck equation coincides 
with that of the original master equation, which is simply the thermodynamical re- 
sult. 

The organization of this paper is as follows. In § [21 the master equation is 
introduced and the expression for its entropy production is given. After that, the 
master equation is transformed to the corresponding Fokker-Planck equation by the 
J2-expansion. In § [3l the Onsager-Machlup theory is applied to the corresponding 
Fokker-Planck equation. By calculating the path probability, the detailed imbalance 
relation is derived. The entropy production term is also determined. In § [U two 
example cases are considered. One is a chemical reaction network. The other is a 
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one-dimensional diffusion system. For both cases, the entropy production disagrees 
with the thermodynamical result. In § [5j to improve the result of the previous 
section, the path weight principle is proposed and applied to the two examples. As a 
result, the modified entropy production based on the path weight principle coincides 
with the thermodynamical result. In § [6j we summarize the results. 

§2. Master equation, /^-expansion, and Fokker-Planck equation 

In this section, we review Gaspard's result 11 ) and the results of the 1970s. 12 )~ 14 )' 17 ) 
Our starting point is the master equation. The master equation describes physi- 
cal and chemical processes, such as diffusion systems and chemical reaction networks. 
In § HI we give two such examples. The master equation is given by 

^P(X; t) = -J2 W(X - X')P(X; t) + J2 W(X' - X)P{X'- 1), (2-1) 

X' X' 

where X = (Xi,X2, ■ ■ ■ , X^) 1 is the variable of the state. P(X; t) is the probability 
distribution that the system is in state X at time t. W{X — > X') is the transition 
probability rate, i.e., the probability that the system performs a transition from state 
X to state X' in a unit time. The entropy production for this master equation was 
recently calculated by Gaspard using KS entropy. n ) Its expression is given by 

We) = ~ £ {P*\X)W(X -> X') - P*\X')W(X> -> X)} In p^C%Z X X) ' 
XX' \ ) \ ) 

(2-2) 

where P st (X) is the probability distribution for the NESS. This expression is ob- 
tained by rewriting Eq. (jl-ip and is equivalent to the expression originally obtained 
by Schnakenberg. 10 ) Thus, in this paper, we call Eq. (j2-2[) the Schnakenb erg- Gaspard 
expression. In addition, it should be noted that this expression is simply the ther- 
modynamical expression. For chemical reaction systems, Eq. (|2-2p is rewritten in 
the form of the sum of the products of the reaction rate and the affinity. Thus, the 
stochastic consideration gives the thermodynamical result for this problem. 

Here the connection between the Schnakenberg-Gaspard expression, i.e., Eq. (|2-2p . 
and the fluctuation theorem (i.e., the path probability ratio) is shown. The path 
probability ratio between the forward path and the reverse path is given by 

P st (A)W path (A -> B) 

P-(B)W P MB^A) = 6Xp[i7(A - (2 ' 3) 

where U(A — > B) is the entropy production for the path A — > B. This relation 
is a key relation in the derivation of the fluctuation theorem. If the time-reversal 
symmetry is satisfied, then the right-hand side of Eq. (|2-3p is 1. Now we assume 
that the forward path is given by 

A _> X M - X® - • • • -» X ( T - x ) -> B. (2-4) 

The path probability is given by the step-by-step transition probabilities as 

W path {A -» B) = W(A -» X^)W{X^ -> X^) ■ ■ ■ W(X( T -V _> B), (2-5) 
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namely in a Markov chain. Let the transition probability be 

The path probability ratio between the forward and reverse paths is given by 

P st (A)W pilth (A -> B) 
° g P st (B)W pat h(B — > A) 

Ft (x (f) )w , (I (t) ^ x (t+i)) 

= 2^ log 



t=o 



= 1 °g ^-bTTuT^Tm 77 + log ■ 



+ ^ P st (* (m) W* (t+1) -XW)' ( } 

Before taking the limit T — > oo, the path average is obtained. Then we have 
(Z"(A -> B)) = (both end terms) 

T-2 

t=l all paths 

xW (X^ -> B)log - { J [ (f Z Jr- ( 2 - 8 ) 

For the NESS, we assume that 

^P st (A)W/W(A -»• X) = P st (X). (2-9) 
A 

We use the Bayes relation 

W(X^ -» B) = P st (x(* +1 ))- 1 TF(X(* +1 ) -» B)P S \B), (2-10) 

and 

TF(X(* +1 ) -► B)P st (B) = P st (X(' +1 )), (2-11) 

where the bar denotes the destined conditional probability. Thus, the average en- 
tropy production is given by 

(a e )=lun o ^(E(A^B)) 

= Y P st (X)W(X -> X>g PS ' (X) ^ (X r (242) 
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Equation (12T2h is simply the Schnakenberg-Gaspard expression, i.e., Eq. (12-2j) , 
Throughout this paper, we call this relation the detailed imbalance expression of 
entropy production. The fluctuation theorem involves the asymptotic behavior of 
long-time fluctuation. However, note that the entropy production in the NESS is 
determined by the detailed imbalance of short-time fluctuation in this formula. 

As in Refs. 12) and 14), the i?-expansion is used for Eq. (|2-ip . Here Q is a 
variable that is related to the system size. For chemical reaction systems, Q should 
be on the order of the Avogadro number or the volume of the system. We set 

W{X^X + r) = f2w(*-,r\ (2-13) 

and scale the variable X, 

* = (244) 

The master equation is rewritten as 

^p(x; t) = -Q £(1 - e-^)w(x;r)p(x; t), (2-15) 

r 

where e = 1/Q is used. The probability distribution is now scaled as 

Q N P{X-t) =p(x;t). (2-16) 

Expanding the right-hand side of Eq. t|2- 15[) in terms of e, we obtain the following 
equation: 



^ f )=EVU) ■Cn(x)P^t), (247) 



71=1 

where 

c n (x) = J2(.r) n w(x;r) (2-18) 

r 

is the nth moment of the transition probability rate. In particular, c\{x) and c 2 (x) 
are given by 

ci,k(x) =^2r k w(x;r), c 2M {x) =^r k r t w(x;r). (2-19) 

r r 

By considering the lowest order of e, we obtain the following equation: 

§f(x;t) = -± • Cl (x)p(x-t) + ~~ c 2 (x)p(x;t). (2-20) 



Here the ^-dependence of c 2 (x) is explicitly considered. Then we obtain 

p(x;t), (2-21) 



d . ± . d 



ci{x) - ~h(x) - e -c 2 (x) ■ ^- 



where 



h{x) = c 2 (x)- . (2-22) 
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Here the term eh(x)/2 can be neglected, because compared with c\, it is on the 
order of e. For later use0 we set 

D(x) = lcsj(aj), (2-23) 

which is the diffusion-constant matrix in the probability space. If the fluctuation is 
assumed to be normal, 12 > i.e., 

p{x;t) = A(x;t)e- n ^ SD ' t) , (2-24) 

the probability distribution is well approximated as a Gaussian distribution on the 
order of e, 

<f>(x; t) = \(x- y(t)f ■ a 1 ■ (x - y(t)). (2-25) 
Then we obtain the time evolution of y(t) and <x(t) as follows: 

f = ci(y), (2-26) 

^- = K-a + a-K + c 2 (y), (2-27) 

where 

K kl (y) = (2-28) 

oyi 

The matrix elements of <x are given by 

o-ij = / d£ pfat), (2-29) 

where 

x = y{t) + e 1 / 2 ^ (2-30) 

and t) is the probability distribution for Thus, a and g correspond to the 
definitions in Ref. 13). Solving Eq. (|2-26|) and inserting its solution into D{x), we 
obtain y(t) and D(t). Therefore, as a result, we obtain the Fokker-Planck equation: 

d 



a . , a 



ci(aj)-ei?(t) j)x 



p(x;t). (2-31) 



Hereafter we investigate this Fokker-Planck equation in detail. 

From Eq. (|2-31j) . several interesting properties for the NESS have been discov- 
ered. 13 ) The probability distribution for the NESS is given by 

" a(x)= 7mwsm eM - mx)] ' <2 ' 32) 

where 

( j ) (x) = ^(x-(x)) t -g st -( X -{x)) (2-33) 



*' Here we used the standard definition of _D, which is different from that in Ref. 13) by a 
factor of 1/2. 
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and 

gS t = (oJrt)-i. (2-34) 

<r st is the variance matrix of the probability distribution of the NESS. In this case, 
the phenomenological equation is given by 

x = _^± 
dx 

= -g st ■ (x - (x)). (2-35) 

If c\{x) is given as 

ci(as) = K st -x + c, (2-36) 
(two examples in § [J] are discussed for this case) , we have 

x = K st -x + c 
= K st ■ (x - (x)) 

= -L X. (2-37) 

Here we have used the fact that x = (x) = —(K^)^ 1 ■ c, where L is the Onsager 
coefficient. Also we have the following relations, 

L = -K st (g st ) _1 = D st + a, (2-38) 
a = -K st a st - D st 

= ^(a st K St -K st a st ). (2-39) 

The matrix a vanishes for the case that the detailed balance is satisfied, i.e., in 
equilibrium. However, for the NESS, a is non zero in general. In addition, a is an 
antisymmetric matrix. As shown in Ref. 13), a is a measure of the circulation of 
fluctuation. Therefore, cc is called the irreversible circulation of fluctuation. 
Now we set 

v(x) = y{x) + D st -V(j){x). (2-40) 

We call the vector v the irreversible circulation velocity. If y(x) = K st -x + c, the 
irreversible circulation velocity can be rewritten as 

v(x) = K st ■ (x - (x)) + D st ■ V(p(x) 
= (K st + D st g st )-(x- {x}) 
= — ol ■ V(p(x) 

= a-X(x). (2-41) 

Therefore, we have 

v(x)=j(x)/P st (x). (2-42) 

Here j(x) is the current of the probability. This relation was also obtained in Ref. 22). 

In addition, the irreversible circulation a is related to the breaking of the 
fluctuation-dissipation theorem. If the fluctuation-dissipation theorem is satisfied, 
i.e., a = 0, then 

- K st a st = D st . (2-43) 

The breaking of the fluctuation-dissipation theorem has recently been recognized for 
the corresponding Langevin system. 18 ) 
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§3. Path probability and detailed imbalance relation 



Following Tomita et al., 17 ) we apply the Onsager-Machlup theory 15 )' 16 ) to the 
Fokker-Planck equation, Eq. (|2 31j) . The time evolution of the probability distribu- 
tion can be written in terms of the transition probability. 



p(x;t) 



dx' F 



x 
t 



X' 

to 



p(x';t ). 



(3-1) 



F(. . . ) is the transition probability. For a short-time propagation, the transition 
probability is evaluated as 



x + Ax 
t + At 



X 

t 



1 



y/{2ir) N det(D(t))(eAt) 



N 



x exp 



Atfi {Ax 



At 



y{x) R 



Ax 
~Al 



+ 0((At) 2 ), (3-2) 



where R = D~ x . From Eq. ((331), the La 

grangian for the path integral (i.e., the 

Onsager-Machlup function) is given by 



C(x, x) 

The path probability is given by 



n 



(x - y(x)Y R (x - y{x)) . 



r r-t 



W P ath({a:}; A -> B) = exp 



ds C(x*(s),x*(s)) 



to 



(3-3) 



(3-4) 



where x*(s) is to be taken along a given path A — > B. We set A = x(to) and 
B = x(t). To calculate the path probability ratio, we evaluate the difference between 
the Lagrangians. 

C(x,x) — £(— x, x) = Qx ■ R- y(x). (3-5) 
Here we assume that the probability distribution in the NESS is given by 

p st (x) oc exp[-(2<f>(x)]. (3-6) 

Thus, we have 

C(x, x) - C(-x, x) = -n<j)(x) + Qx ■ R st ■ [y(x) + D st ■ V<p{x)] , (3-7) 
in which we have used the relation (fi(x) = • x. Then for the NESS, we obtain 
P st (A)W path ({x};A^B) 



P si (B)W path ({x};B^A) 



exp 



B 



Q dtx 1 R st v 



(3-8) 
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Similar relations were also obtained for Langevin systems by Taniguchi and Co- 
hen, ' 

-21)0 

Seifert, 22 ) and Chernyak et al. 23 ^ If the detailed balance relation is 
satisfied, the right hand side of eq. f|3-8|) is equal to 1, i.e., it is in equilibrium and 
the entropy production is zero, because a = 0. It is known that compared with 
the Onsager-Machlup theory, the argument of the exponential function is related to 
the entropy production. Therefore, the argument of the exponential function on the 
right-hand side is the entropy production rate for the path A — > B. Thus, we finally 
obtain a stochastic form of the entropy production rate, 

a e (x,x) = Qx l ■ R st ■ v(x). (3-9) 

Next, consider the average value of the entropy production term. As in the 
Onsager-Machlup theory, the most probable paths are categorized into two types, 
i.e., the forward evolution and the reverse evolution. For the forward evolution, the 
most probable path is given by 

x = K st ■ x + c = K st ■ (x - (x)). (3-10) 

Inserting Eq. (|3- lOj) into Eq. (|3-9p gives 

a e (x) = Q {K st ■ (x - (x))Y ■ R st a ■ X(x). (3-11) 

Taking an average over the NESS, we obtain 

(a e ) = Jdx P st {x)a e {x) 

= -Tv(aR st ag st ). (3-12) 

This is the central result of this section, i.e., another form of the detailed imbalance 
expression. Note that the entropy production is expressed in terms of the irreversible 
circulation a. If in equilibrium, i.e., the detailed balance is satisfied, a is zero. Then, 
the entropy production vanishes. This is consistent with the physical requirement. 
It is important that the entropy production is expressed as a quadratic form of a. 

§4. Examples 

In this section, we check whether or not the derived expression of the entropy 
production coincides with the thermodynamical expression. Two examples are con- 
sidered. One is a chemical reaction network. The other is a one-dimensional diffusion 
system. 

4.1. Chemical reaction network 

Let us consider the following simple case: 

A^X^Y^B. (4-1) 



They called this relation the nonequilibrium detailed balance relation. 
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Here all rate constants are equal to k. To maintain the steady state, the concentra- 
tions of the chemical species A and B are kept constant by reservoirs. This chemical 
reaction system is linear. Using Eqs. (|2-28p and (|2-36[) . the matrix K st and the 
vector c are given by 

X* = 4~? \),c=k(%), (4-2) 



i -2 ; ' v < fe > 

where (a) = (A)/f2 and (6) = (B)/Q. Using Eq. (|2^23D for D st , Eq. (12^28]) for K s \ 
and making the right-hand side of Eq. (|2-27|) equal to zero, we obtain the matrix 



er st . 



t _ 1 / 2(a) + (6) . 

~3\ (a) + 2(6) I' ^ 



Using Eq. (|2-39j) . the matrix a is given by 



a= ^)-^))( o i , (4 . 4) 



6 V - 1 

The entropy production derived from the Fokker-Planck equation becomes 

(<r e ) = -Ti(aR st ag st ) 

4«a) - (6)) 2 

= K 



23(a) 2 + 62(a)(6) + 23(6) 2 
4fc«a) - (6)) 2 



27«a) + <6»s 



(4-5) 



The last line is the approximation near equilibrium, i.e., (a) ~ (6). We have employed 
an expansion with a symmetric form. 

In the thermodynamical consideration, the entropy production is given by 

^,th = E^Y' (4 ' 6) 

i=l 

where 

(4-7) 
(4-8) 
(4-9) 

Ji is the reaction rate of reaction i and Ai is the affinity of reaction %. This expression 
is equivalent to Eq. (|2 2|) . Near equilibrium, the entropy production is 

^ 2«fl((q) - (6)) 2 
^ 3((a) + (6)) ' (440) 

The result of Eq. (|4-5p disagrees with the thermodynamical result of Eq. (|4-10p . 



Jl = 


k((A) 


- (X)), 


A! 


= Tlog 


'(X) 


J 2 = 


k((X) 


~ (Y)), 


A 2 


= Tlog 


.(X) 

•<y> 


Js = 


<{Y) 


~ (B)), 


A 3 


= Tlog 


.(Y) 
'(B) 
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4.2. One- dimensional diffusion system 

In this subsection, a one-dimensional diffusion system is considered. The system 
is a pipe with the cross section U. This pipe is divided into L cells of length A. Thus, 
the volume of each cell is I? = XU. Particles exhibit a random walk between cells. 
All rate constants are given by k. The reaction is represented as 

tz tz tz tz tz . 

A^Ni ^N 2 ^ ... ^N L _i ^B. (4-11) 

tz tz tz tz tz 

The time evolution of the population N is determined by the following rate equation: 

N i = K (N i+1 -2N i + N i ^ 1 ), (4-12) 

and at both edges, 

iV = A, N L = B. (4-13) 

At the edges, a constant number of particles is supplied by reservoirs. We denote 
the density of the particle in the ith cell by m, i.e., n% = Ni/Sl. 

hi = K(n i+ i - 2n,i + nj_i) 

w kA 2 VV (4-14) 

Thus, the spatial diffusion coefficient is given by 

V = kX 2 . (4-15) 

Now let us consider the master equation for this system. The transition probabilities 
are given by 

W(..., Ni,N i+1 , > . . . , Ni - 1, N i+1 + 1, . . . ) = KN i; (4-16) 

W(..., Ni,N i+1 , ► . . . ,Ni + 1, N w - 1, • ■ ■ ) = KNf+L (4-17) 

This problem was analyzed in the context of the fluctuation theorem. 24 ) The steady 
solution of the master equation is multi-Poissonian. 

L ~ l tN\ N * 

p st (^i^2, . . . , iVL-o = n e ~ mJ §r- ( 4 - 18 ) 

i=l l ' 

The thermodynamical entropy production is given by 

^^m^. ( , 19) 

This equation is equivalent to the Schnakenberg-Gaspard expression, Eq. (|2-2p . One 
can confirm by inserting Eq. (|4-18p into Eq. (|2-2p . that Eq. (|4-19p is satisfied. In the 
continuous limit, we have 

f LX \Vn(x)\ 2 

cr e>th = EV / dx l - ^fi-, (4-20) 

Jo n \ x ) 
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where U dx is the volume element here. In the last line, we employed the linear 
approximation near equilibrium. 

Using Eq. (|2-19p . the moments are calculated as 

Clji = n(n i+ i - 2m + nj_i), (4-21) 

C2,i,i = K>(n i+ i + 2m + n,i-i), (4-22) 

C2,i,i+i = c 2j i + i,i = K(ni + n i+1 ). (4-23) 

For C2, other entries are zero. The matrices l^ st and D st are given by 



K 



St 



/ "2 
1 







V 



i 





1 



o \ 






(4-24) 



and 



St 



D 



Jl st 



-(nf_ 1 + 2nf +n\ 



st \ 



2kU 



St 



-~(nf + n st 



(4-25) 
(4-26) 



For D st , other entries are zero. We used the fact that the steady solution is given 
by 



n 



St 



no — iA|Vn|. 



(4-27) 



The variance matrix er and the circulation matrix a are given by 



( nf 












St 



11 



St 

L-2 



o \ 




(4-28) 



and 



ot 



2 V 



st _st\ 



/ o 

-1 




V 



K st a 

1 





-1 



o \ 







1 
-1 J 



(4-29) 
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The entropy production for the corresponding Fokker-Planck equation is given by 
Eq. (|3-12p . Then we have 



This result does not agree with the thermodynamical result of Eq. (|4-20p . In par- 
ticular, the order of Eq. (|4-30p is different by a factor of l/f2 compared with that of 
Eq. (|4-20p and the concentration dependence disagrees. 



As shown in the previous section, the entropy production derived directly from 
our Fokker-Planck equation disagrees with that of the original master equation and 
the thermodynamical equation. This discrepancy should be examined. 

First, let us consider the reason for this discrepancy. Our original master equa- 
tion describes the phenomena of discrete jumps such as the occasional collisions in 
the chemical reaction system. On the other hand, the corresponding Fokker-Planck 
equation treats the averaged continuous evolution of the original physical random 
process. This relation is similar to that between a random walk and Brownian mo- 
tion, which corresponds to the former. Note that the different random walks, say, 
(i) random jump ±A at each mean interval tq, and (ii) random jump ±2A at each 
mean interval 4ro, are described by the same Brownian motion with the diffusion 
coefficient D = A 2 /2tq. However, the entropy production differs for each case, i.e., 
that of case (i) is four times larger than that of case (ii). This fact tells us that the 
Fokker-Planck equation and the Brownian motion cannot be used for the purpose 
of calculating the correct entropy production, at least, when the original master 
equation describes a discrete stochastic process. However, they accurately describe 
the long-time evolution of the probability itself due to the central limit theorem. 
The entropy production is due to the short-time behavior of fluctuations, i.e., the 
detailed imbalance relation. Entropy is created at each discrete jump process such 
as reactive collisions among atoms or molecules in the chemical reaction. Let us call 
these discrete jump process the elementary process of entropy production. 

Second, let us introduce the path weight principle, which is a type of corre- 
spondence rule for overcoming this difficulty. The above consideration suggests that 
to calculate the correct entropy production in the present Fokker-Planck scheme, 
we should take account of the number of elementary processes included in a given 
continuous stochastic path. 

For example, let us consider the following chemical reaction network, 




-Tr{aR st ag st ) 
KA 2 |Vn| 2 2(L-2)(L-l) 
4W 2 " I 





(4-30) 



§5. Path weight principle 



pth reaction: 
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The elementary random walk comprises each reactive collision which means that 
AY p = ±1 in a mean interval where Y p is the reaction coordinate of the 

pth reaction defined by 

SXi = ^(I7 p4 - Vpi )SY p . (5-2) 
p 

Using the reaction coordinates as the set of stochastic variables, the frequencies of 
the positive and negative reactions in the pth direction per unit time are related to 
the second moment of the transition probability, 

2(2Lf$ = W(AY p = +1)(+1) 2 + W(AY p = -1)(-1) 2 , (5-3) 

when the reaction flow can be neglected in near-equilibrium situations. This condi- 
tion will be satisfied in the linearized, local-equilibrium estimation below. 

Thus, the diffusion constants directly give the number of elementary random 
walks in a unit time if the reaction rates satisfy However, it is difficult to 

find a general correspondence rule for the population coordinate {Xi} except for the 
following special cases. 

5.1. One- dimensional diffusion system 

In the diffusion model used in § [H the rate constants assumed to be a 

constant, k, i.e., 

ith reaction: Nj ^ N m , {i = 0, 1,2, . . . ,L - 1) (5-4) 

K 

where No = A and = B. The diffusion matrix in the reaction coordinates is given 
by a diagonal matrix {Df^Sij}, where 

D'f = ^nf + nf +1 ), (5-5) 

with rtj = Ni/fi. The elementary process in this case is a jump of one particle in a 
given cell to the left or right cell in the mean interval time, that is, a uniform 
random walk in the one-dimensional real space. Therefore, at least in this special 
case, the number of elementary jump processes included in a continuous unit-time 
path in the ith direction is given by the ratio, 2QD'\ / k. Then the correspondence 
rule in this case is given by 

fji — ► 2n- l f2D'l%i, (5-6) 

where rj p = Y p /Q. Thus, the diffusion constant can be used for the path weight. 

In the concentration space let us assume that the same correspondence 

rule can be applied in the principal-axis space where the diffusion matrix {-Dfj} is 
diagonalized, although we have no definite principle for determining the coefficient 

itself in the present case. Note that this space is not necessarily equivalent to 
the reaction coordinate space We have the linear relations, 



n % = /XS P) i-i - 8 P; i)<f} p , 
p 



(5-7) 
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and 

p 

where 8 P i is the usual Kronecker delta. However, this transformation is not repre- 
sented as a square matrix, i.e., it is not invertible and not an orthogonal transfor- 
mation. 

Thus, we obtain a hypothetical correspondence rule in the concentration space 



^2K~ 1 QDt j h j . (5-9) 



m 

3 

Let us call this the path weight principle. 

As a result, we have a corrected expression for the entropy production rate, 

(a e )' = -2k- 1 f2 Ti(ag st a). (5-10) 

Here the prime means that the entropy production is modified by the path weight 
principle. Using the explicit forms of a and g st in § HI we obtain a final result, 

. [ LX V\Vn(x)\ 2 

in the continuum limit L — > oo, where T> = k\ 2 is the spatial diffusion constant. 
This coincides exactly with the thermodynamic result, i.e., Eq. (|4-20j) . 

5.2. Chemical reaction network 

The path weight principle may also be applied to the simple chemical reaction 
(L = 3) in § 14.11 An simple result for the evaluation of the entropy production is 
given by 

2 K Q((a) - (b)) 2 
{ae) = 9«a> + <6» ' (5 ' 12) 
in a symmetrized form near equilibrium. Compared with Eq. (|4-10p . there is a 
difference of a factor of 1/3. 

The reason for this is evident. We should treat the boundary effect more carefully 
for finite L. In the present case there are three different random walks in the xy- 
plane, i.e., two boundary modes lo along the x-axis and Yi along the y-axis in 
addition to the diagonal mode Y\ in the direction (1, —1). Therefore, the elementary 
processes are not isotropic in the xy-plane. 

Instead of performing this ambiguous transformation, the reason for the factor 
of 1/3 may be that the irreversible circulations corresponding to both end reactions 
have not been taken into account in the present scheme. It can be easily shown that 
this factor of 1/3 is removed when the variables A and B are added to the set of 
stochastic variables as 

(5-13) 
(5-14) 
(5-15) 
(5-16) 



A = 


k(X 


-A)-c, 


X = 


k(A 


-2X + Y) 


Y = 


k(X 


-2Y + B) 


B = 


k(Y 


- B) - c', 
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where c and c' are parameters controlled by external equilibrium reservoirs to keep 
A and B constant. Here c = k((X) — A) and d = k({Y) —B). Except for the matrix 
K st , which is modified slightly to 



/ 


-1 


1 








\ 




1 


-2 


1 












1 


-2 


1 




V 








1 


-1 


/ 



the other quantities are exactly the same as those given in § 14.21 for L — 1 = 4. 



§6. Concluding remarks 



We have shown that the entropy production of the Fokker-Planck equation de- 
rived from the master equation differs from that for the original master equation. 
The reason for this is clearly due to the fact that the master equation treats discrete 
events, but the Fokker-Planck equation is an approximation of the master equation. 
In the Fokker-Planck equation, the original discrete events are smoothed out. To 
evaluate the entropy production, one has to recover the discreteness of the events in 
the treatment of the corresponding Fokker-Planck equation. To overcome this prob- 
lem, we have proposed the path weight principle. The entropy production from the 
corresponding Fokker-Planck equation is modified by multiplying by the diffusion 
coefficient. For two simple examples, it has been demonstrated that the path weight 
principle yields the entropy production for the original master equation. 

At present, we do not know whether or not the path weight principle can be 
applied to any type of master equation. However, we believe that the path weight 
principle can be applied, at least, to the cases in which jumps in the transitions are 
small compared with fi, namely \A\ ~ 1. 
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